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Abstract 



C/3 . We explore the SNR-optimal relay functionality in a memoryless relay network, i.e. a network where, during each 

channel use, the signal transmitted by a relay depends only on the last received symbol at that relay. We develop 

(N 

^ ' a generalized notion of SNR for the class of memoryless relay functions. The solution to the generalized SNR 

(N 

' optimization problem leads to the novel concept of minimum mean square uncorrelated error estimation(MMSUEE). 
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For the elemental case of a single relay, we show that MMSUEE is the SNR-optimal memoryless relay function 
regardless of the source and relay transmit power, and the modulation scheme. This scheme, that we call estimate and 



^ ' forward (EE), is also shown to be SNR-optimal with PSK modulation in a parallel relay network. We demonstrate 



that EF performs better than the best of amplify and forward (AF) and demodulate and forward (DF), in both parallel 
and serial relay networks. We also determine that AF is near-optimal at low transmit power in a parallel network, 
while DF is near-optimal at high transmit power in a serial network. For hybrid networks that contain both serial 
and parallel elements, and when robust performance is desired, the advantage of EF over the best of AF and DF is 
found to be significant. Error probabilities are provided to substantiate the performance gain obtained through SNR 
optimality. We also show that, for Gaussian inputs, AF, DF and EF become identical. 



Index Terms 

Estimate and forward, memoryless relay networks, relay function, MMSUE, parallel relay networks, serial relay 
networks, hybrid relay networks 
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I. Introduction 

The traditional wireless communication problem is to design effective coding and decoding techniques to enable 
reliable communication at data rates approaching the capacity of a chaimel. The chaimel is defined by a set of 
given assumptions regarding the physical signal propagation environment between the transmitter and the receiver. 
However, recent focus on cooperative communications presents a remarkable change of paradigm where in addition 
to the physical environment, the network is the channel [1]. In other words, with cooperative communications 
the effective channel between the original source and the final destination of a message depends not only on the 
given physical signal propagation conditions but also the signal processing at the cooperating nodes. The change 
of paradigm is quite significant. With cooperative communications, not only is there a need to optimally design 
the encoder and decoder at the source and destination, but also to design the channel itself by optimally choosing 
the functionahty of the intermediate relay nodes. The choice of relay function is especially important as it directly 
affects the potential capacity benefits of cooperation which have been shown to be quite significant [2]-[6]. 

A number of relay strategies have been studied in hterature. These strategies include amphfy-and-forward [7] 
[8], where the relay sends a scaled version of its received signal to the destination, demodulate-and-forward [8] 
in which the relay demodulates individual symbols and retransmits, decode-and-forward [9] in which the relay 
decodes the entire message, re-encodes it and re-transmits it to the destination, and compress-and-forward [10] [4] 
where the relay sends a quantized version of its received signal. In [11], gains are determined for AF relays to 
minimize the MMSE of the source signal at the destination. It is shown that significant savings in power is achieved 
if there is no power constraint on the relays. Similarly in [12] gains for AF relays in a multiuser parallel network 
are determined that realizes a joint minimization of the MMSE of all the source signals at the destination. 

From a practical standpoint, the benefits of cooperation are offset by the cost of cooperation in terms of the 
required processing complexity and transmit power at the relay nodes. The complexity of the signal processing 
at the relay could range from highly sophisticated decode-and-forward or compress-and-forward techniques [13] 
that require joint processing of a long sequence of received symbols to memoryless schemes such as amplify-and- 
forward or demodulate-and-forward that process only one symbol at a time. Clearly, the most desirable schemes are 
those that approach the limits of cooperative capacity with minimal processing complexity at the relays. Memoryless 
relay functions are highly relevant for this objective. In addition to their simphcity, memoryless relays are quite 
powerful in their capacity benefits. For example, the memoryless scheme of amplify-and-forward is known to be the 
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capacity-optimal relay scheme for many interesting cases [1], [14]-[17]. The effect of finite block-length processing 
at the relay on the capacity of serial networks is analyzed in [18], [19]. In [20], the memoryless MMSE estimate 
and forward scheme has been shown to be capacity optimal for a single relay system. For a single relay and with 
BPSK modulation, the BER-optimal memoryless scheme is found by Faycal and Medard [21]. The BER-optimal 
relay function turns out to be a Lambert W function normalized by the signal and noise power. 

In this paper we explore the SNR-optimal signal processing function for memoryless networks with possibly 
multiple relays. While SNR optimality does not always guarantee capacity or BER optimality, it is a practically 
useful performance metric. SNR-optimization is especially interesting for its greater tractabihty that allows analytical 
results where capacity and BER optimizations may be intractable, e.g. with multiple relays. 



Throughout the paper, S [.] denotes the standard expectation operator, * represents the conjugation operation. | . | 
and 9^e(.) denotes the absolute and real part of the argument respectively. 

II. Shaping the Relay Channel: Amplification, Demodulation and Estimation 

In this section, we discuss the relay functions of common memoryless forwarding strategies and provide new 

perspectives that lead us to a novel and superior memoryless forwarding technique. 

A. Soft and Hard Information: Amplify and Demodulate 

Within the class of memoryless relay strategies, amplification and demodulation are the most basic forwarding 
techniques [8]. An AF relay simply forwards the received signal r after scaling it down to satisfy its power constraint. 
The relay function for AF can be written as 



Evidently with AF, the relay tries to provide soft information to the destination. A disadvantage with this technique 
is that significant power is expended at the relay when |r| is high. In DF schemes, demodulation of the received 
symbol at the relay is followed by modulation with its own power constraint Pr. For BPSK modulation, the relay 
function for DF can be expressed as 



A. Notations 




(1) 




(2) 



where sign(r) outputs the sign of r. Due to demodulation, the relay transmitted signal carries no information about 
the degree of uncertainty in the relay's choice of the optimal demodulated symbol. Demodulation at the relays 
can lead to severe performance degradation in some scenarios. For example, in a parallel relay network, reliability 
information can be utiUzed to achieve better performance over DF. 

From the relay functions of AF and DF, one can argue that an optimal relay function should provide soft 
information when there is an uncertainty in the received symbol, and at the same time should not expend a lot of 
power when the cost of power out-weighs the value of soft information. 

B. Estimate and Forward: A Novel Memoryless Forwarding Strategy 

The forwarding schemes can also be related to the fundamental signal processing operations: detection and 
estimation. In DF, the relay demodulates the received symbol employing MAP detection rule, which is the optimal 
detection technique. So a DF function can be viewed as a MAP detector followed by a modulator. In a similar 
vein, AF can be viewed as a linear MMSE^ estimation scheme followed by normalization to satisfy the relay power 
constraint. 

fAF{r) = P'Xiinear{r) 

where the Unear estimate Xnnearir) obtained at the relay is given by 

P 

X linear {^ ) P -\- \ ^ ^ 

and 



P = 



p2 



Viewing AF as Unear MMSE leads naturally to the forwarding scheme of EF where the unconstrained MMSE 
estimate is forwarded. The unconstrained MMSE estimator which minimizes the distortion is given by 

X(r) = £{x\r). 



'Because of the normalization associated with the relay power constraint all Unear estimates are equivalent 



5 



4 



2 



-2 



-3 







AF: Power Inefficient x 

\ X 




— — Amplify 

Estimate 

- Demodulate 


- 




DF: No Soft Information ^-"^ 

1 ^- EF: Power Efficient 

_ 1 ./ \ 


- 









. 

















-5 -4 -3 -2 -1 1 2 3 4 5 

Relay Input r 

Fig. 1. Relay function of common forwarding schemes (P=l) 

1) Relay Function for EF with BPSK modulation: When the source employs BPSK modulation, the MMSE 
estimate at the relay is given by 

X{r) = \/Ptanh(\/Pr), (3) 
where tanh(z) returns the hyperbolic tangent of z. The relay function is therefore, 

= \/ £[tanJ(v/p.)] '"'''^''' 

Note that aU the memoryless schemes operate at sampled output of the matched filter. In this regard all the schemes 
have similar processing complexity. It is worth noting that while EF and AF require amplitude digitization, DF 
does not. Figure ^ shows the relay functions for AF, EF and DF for P = 1. It can be seen that the relay function 
fEF is linear for small values of \r\. Its slope reduces gradually and ultimately becomes flat similar to foF- The 
function fEF = \/P ianh{-\/~Pr) is intuitively appealing for the following characteristics. 

• Soft information in region of uncertainty. 

• Limited power in region of high power cost. 

The insights obtained in this section will be useful in understanding optimum relay functionalities in a multiple 
relay network. In the next section, we determine the optimal memoryless strategy in a single relay network. 
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III. Single Relay Channel 

A. Problem Statement 

Consider an elemental relay channel model as shown in the figure below, in which a single relay R assists the 
communication between the source S and the destination D. Both S-R and R-D links are assumed to be non-fading. 

® <S) -® 

X f{x + ni) y = f(^x + ni) + n2 

Elementary Relay Channel 

There is no direct link between the source and the destination, which may be due to the half duplex constraint 
of the nodes, where in the first slot D serves a different set of nodes. The transmit power at the source and the 
relay is P and Pr respectively. At both the relay and the destination, the received symbol is corrupted by additive 
white Gaussian noise of unit power. Relay R observes r, a noisy version of the transmitted symbol x. Based on 
the observation r, the relay transmits a symbol /(r) which is received at the destination along with its noise n2. 

r = X + ni 

y = f{r) + n2 (4) 

The relay function / satisfies the average power constraint, i.e. £r P] = Pr- Without loss of generahty, 
channel gains for the source-relay and the relay-destination hnk can be incorporated into the model by modifying 
P and Pji appropriately. We seek to determine the memory less relay function /(.) that maximizes SNR at the 
destination. 

B. What is the definition of SNR? 

Given an observation y, that contains a desired signal x as well as some distortion (noise), SNR is traditionally 
defined as the power of the signal Px divided by the power in the noise component P„. For observations of the 
form y = X + n where the observed power Py = P^ + Pn (i.e. signal and noise are uncorrelated) it is easy to 
separately identify the contribution of the signal power and the noise power to the observed power. However, what 
is the definition of SNR if the observation y is not already exphcitly presented in the standard form y = x + n with 



uncorrelated signal and noise components? In general, the observation y may have an arbitrary and possibly non- 
linear dependence on the desired signal x. For example, consider the signal at the destination: y = f{x + ni) + n2 
with an arbitrary function /() describing the memoryless relay functionality. In order to define SNR one needs 
to separately identify the power contributions of the signal and noise components to the observed signal y. If we 
can identify Py = + Pn then the definition of SNR readily follows as In other words, the definition of 
SNR follows from a representation of the observation y in the form y = x + n, with uncorrelated signal and 
noise components. To this end, we view the signal y as a scaled version of the sum of the signal x and an error 
component Cu uncorrelated with x. 

£\x*y] 

y = f[x + n) = {x + eu). (5) 

c [\x\'^\ 

Notice that any signal y can be expressed as above regardless of whether y is a linear or non-linear function of 
x + n. Rearranging 

= - X. (6) 

£{x*y\ 

It is easy to verify that is uncorrelated to x. 

c\ * ^ r J, ( £'\\x\ 

t\x eu\ = £ 



ry-x 



(7) 



£[x*y] 

= ^J^£[x*y]-£[x*x\=Q (8) 
£ [x*y\ 

To calculate the SNR of the received signal y, we need to identify the error term in the received signal y, that 
is uncorrelated to the signal x. The scaling factor in (El is common to both the signal and en^or terms. 

Therefore, the generalized SNR is defined as follows: 

^'^^ - - £[\ay-x\^y 

where a = ^[p^- The advantage of the generalized definition lies is its applicability to both linear and nonlinear 
relay functions. Note that the conventional definition of SNR for point to point links is a special case of the 
generalized SNR. For example, consider a received signal y = hx + n. The conventional SNR is \h\'^P. To obtain 
the generalized SNR, we need to express y as a sum of the signal x and uncorrelated error in the following 
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form. 

where f|^jl| = h, in this case. Therefore e„ = The generaUzed SNR from Q is, 

GSNR= = 

w 

which is also the conventional definition of SNR. 

The GSNR concept can be viewed as a decomposition of an observation into a component along the desired 
signal space and its orthogonal signal (uncorrelated noise) space. The orthogonal projections are evident in the 
second moment constraint Py = + Pn (Pythagoras Theorem). GSNR is therefore as natural and meaningful a 
metric as the orthogonal projections themselves. While GSNR optimization does not guarantee capacity or BER 
optimality it is interesting to note that all three metrics(BER, capacity, GSNR) lead to very similar optimal relay 
functions for BPSK. The BER optimal Lambert-W function is very similar to the GSNR optimal tan-hyperbolic 
function(EF). Moreover, in a separate work we have shown that, numerically, the GSNR optimal EE function is 
also capacity optimal for BPSK [20]. To summarize, GSNR optimality is related to capacity and BER optimality 
and offers a tractable performance optimization metric. 

C. Optimal Relay Function 

We first derive the optimal estimation method that maximizes GSNR. Based on this result, we determine the 
optimal relay function. 

Theorem 1: Given an observation r that contains both the signal x and noise n, the MMSUE (SNR maximizing 
estimate) of x is 

regardless of the input and the noise distributions. 

Proof: Without loss of generality, any estimator X{r) can be expressed as 

X{r) = x + eu, 



where e„ is uncorrelated with x. It is clear from @ that minimizing the mean square uncorrelated estimation error 
(MMSUEE), <S[|e„p] amounts to maximizing SNR. The optimization problem is therefore to minimize iS[|eup] with 
respect to X{r) subject to the constraint that e„ is uncorrelated with x. The constraint is equivalent to <?[xe*] = 
as £[x\ = for all signal constellations. Employing Lagrange multipliers^, we write the constrained minimization 
as the minimization of 

E = S[\eu\'']-\£[x*eu]-\*£[xei] 

= E[\X{r) - x|2] - \£[x*{X{r) - x)] - \*£[x{X*{r) - x*)] 

= £[\X{r)\^] + (-A + l)8[x*X{r)] + (-A* + l)£[xX* {r)] - P{-\ - A* - 1) 

= £r \\X{r)\^ - (A - l)X{r)£[x*\r] - (A* - l)X* {r)£[x\rA + P(A + A* + 1) 

= 8r \\X{r) - (A - l)£[x\r]\^ - l(A - l)^^[2;|r]|2j + P(2^e(A) + 1) 

From the above equation, it is clear that E is minimized when 

X{r) = {\-l)8[x\r], 

and the minimum mean squared uncorrelated estimation error is 

E* = P(2$ne(A) + 1) - |A - l\^\£r [\£W]\^] (10) 



From the constraint that 



S[x*eu] = ^ £[x*X{r)\ = P, 



we have 



A-l ^ 



£[x*£{x\r)] 

Therefore X{r) = is the SNR maximizing estimate. It should be noted that the above result is 

completely general and is valid for all input and noise distributions. ■ 

This result impUes that any scaled version of MMSE estimator is GSNR optimal. Thus regardless of the power 
constraint at the relay, EE maximizes GSNR at the output of the relay. 

^As the constraint f [xe*J is a complex quantity, tiie Lagrange multipliers are A and A* corresponding to £"[3:6^ and £[x*eu] respectively. 
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Theorem 2: In a single relay network, maximizing GSNR at the output of the relay amounts to maximizing 
GSNR at the destination. 

Proof: Consider any estimate X{r) = x + e^, with 8 [je^p] = E, the uncorrected estimation error power. 

Let f{r)=aX{r) (11) 
where = satisfies the relay power constraint. The received symbol at the destination is 

y = aX{r) + n = a{x + e^) + n 
The GSNR at the destination is given by 

a'^P P 

GSNRfl = ^ = (12) 

Clearly minimizing E amounts to maximizing GSNR at the destination. ■ 
As scaling does not alter the GSNR of the estimate, forwarding MMSUE and MMSE results in the same relay 

function. The fundamental relationship between these estimation methods is discussed in Appendix |X] From the 

results of theorem ^ and theorem |2l we have the following theorem for the optimal relay function. 

Theorem 3: For a network with a single relay that has a power constraint Pr, the relay function that maximizes 

GSNR at the destination is 



/(r) = ./ „ £[x\r], 

regardless of the input and noise distributions. 

Thus the new memoryless forwarding strategy, estimate and forward is GSNR optimal in a single relay network. 
In the next section, we compare the performance 

IV. Comparative Analysis 

From the mean square uncorrelated estimation error at the relay, the SNR at the destination for any forwarding 
scheme can be obtained directly from (I12t . Therefore calculation of uncorrelated error power of DF and AF allows a 
direct comparison of these schemes with the SNR optimal EF. To determine the estimate whose error is uncorrelated 
to the signal x from the actual relay function, we only need to obtain the scaling factor that allows the relay function 
to be expressed as in The relay function for DF depends on the modulation scheme as discussed earlier. In this 
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section, we compare the schemes for BPSK modulation and illustrate the concept of generalized SNR. 

A. Demodulate and Forward 

We express the relay function of a demodulating relay as 

/ — [Pr. 
forix + n) = VPRSign(x + n) = J —{x + d) 

where d is the Euclidean distance between the input symbol x and the demodulated symbol. The distribution of d 
conditioned on x is given by 

1 - e 

d={ (13) 

2x e 

where e = Q ^\/Pj, the probability of symbol error. As seen from the error distribution, the demodulation error 
d is correlated with x. The correlation between the input and the error is given by 

e{xd) = -2Pe. (14) 

The uncorrected error can be calculated from ^ according to which 

P p 

fDF{x + n)-x = — — ——{x + d) (15) 



" 8{xfDF{x + n)y ^ ' P-2Pe 
From (ITH l. the power of the uncorrected error in ( fT5t can be calculated and is given by 

MSUEEZ5F = (16) 
(1 - 2ey 

To characterize the mean squared uncorrected error at the output of the DF relay, we first consider e, the probability 
of decision error at the relay. 

3Xp( )dx = 7= / 



/ \ 1 x^ 11 



For small values of P, 
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10 log P (in dB) 

Fig. 2. Uncorrelated error power vs transmit power with BPSK modulation 



Therefore at low source transmit power, the mean squared uncorrelated error can be expressed as a function of P. 



MSUEEDir(P) = 




As P ^ 0, the uncorrelated error power shoots up to |. It should be noted that the noise variance at the relay is 
1. This suggests that DF is not preferable at low P. 

B. Amplify and Forward 

As the relay function of an AF relay is a scaled version of the received signal r, it is simple to determine the 
mean squared uncorrelated error. From we have 

P 

^« = rr *f — ? — ; — vifAFix + n)-x = n 
t:[x*fAF[x + n)\ 

The uncorrelated error power is therefore the same as the noise variance, MSUEE^ii? = 1, interestingly independent 
of the source transmit power. 

Fig. |2l plots the uncorrelated estimation error as a function of transmit power for all the three schemes. Several 
interesting observations can be made. It can be seen that AF is close to optimum (EE) at low P while DF is near 
optimal at high P. In the intermediate range, both AF and DF are far from optimal. It is well known that AF 
suffers from noise amplification at low SNR [22], which is in contrast to the results here. When we view the relay 
operation as an estimation, it is only natural that the estimation error is high at low P, which results in noise 
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amplification. In fact AF is very close to optimum among all memoryless function at low P. Rather it is DF that 
suffers the most from noise/error-^ amplification. However AF is inefficient at high P as MSUEE^^? = 1 does not 
decrease with P, while uncorrelated error in DF and EF vanishes at high P. The mean squared uncorrelated error 
power of the schemes for extreme values of P is listed in Table |l] 



MMSUE 


Relay Function 


P^O 


P^OO 


Amplify 


1 


1 


Demodulate 


TV 

2 





Estimate 


1 






TABLE I 

Uncorrelated error power at output of relay for BPSK modulation. 



C. Higher Order Constellations 

We know from theorem |3] that EF is GSNR optimal for all modulation schemes. For fixed input power P, 
increasing the number of constellation points M will result in an increased mean squared uncorrelated power for 
EF. This is rather intuitive from the fact that increasing the number of constellation points for fixed power increases 
the estimation error. Fig. |3l shows the relay functions for 4-R\M constellation set. Interestingly, the relay functions 
of the schemes become more and more similar with increase in constellation points. 

For Gaussian inputs, the unconstrained MMSE estimate and the linear MMSE estimate are equivalent. 

Thus AF and EF strategies are the same for a Gaussian source. In this context, it can also be shown that DF and 
AF are equivalent for Gaussian inputs. The notion of demodulation of symbols from a Gaussian source is explained 
through the following. A Gaussian distribution is quantized into a number of states with the probability of the i*^ 
state given by. 

Suppose the source transmits symbols Xj according to the probability distribution above, then the MAP detection 
^the term 'error' is more appropriate as noise process is usually independent of the input 
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Demodulate 

■ Estimate 



Received Symbol " 



Fig. 3. Relay Functions for 4-PAM modulation 
rule at the relay is given by 



X{r) = argmax Pr(x|r) 



In the limit Ax ^ 0, x and r become jointly Gaussian. It is well known that the conditional mean 8{x\r) maximizes 
the joint probability. Therefore 8{x\r) which is also the MMSE estimate is the output of the ML detector. Thus 
for Gaussian inputs AF, EF and DF are identical. 

V. Parallel Relay Network 

A Gaussian parallel relay channel [14] is shown in Fig. |4] It consists of a single source destination pair with L 
relays that assist in the communication. All the links are assumed to be non-fading with unequal channel gains and 




Fig. 4. Gaussian Parallel Relay Channel 



information is transferred in two time slots. The relays observe {rjj^j^, the noisy version of the transmitted signal 



ri = QiX + Ui 



(18) 
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where gi is the gain of the Unk between the source and the i^^ relay, rii denotes an additive Gaussian noise with 
a^-l. Since the relays are assumed to be memoryless, each relay Ri transmits a signal that is a function of its 
observation r^. We assume that the relay function in a parallel relay network is the same for all the relays, although 
the channel gains of the relays may be different. Strictly speaking, an optimal power allocation based on the channel 
gains is necessary. However, it is beyond the scope of the paper. For ease of notation, we denote the transmit power 
at the source as P and the relay transmit power as {Pi}^^^. Without loss of generality, the channel gain for the 
relay destination links can be introduced through the relay transmit power. The destination receives the sum of all 
the relay observations along with its own noise. 

L 

y = ^f{ri) + n 

i=l 

By viewing relay operation as an estimation we have, 

fi^i) = figix + rii) = ai{x + ei) 

where Cj is the uncorrelated estimation error at the z*^ relay, = ^J p^^, and Ei = £[\ei\^], the mean square 
uncorrelated error power associated with the relay function. The received signal at the destination can be expressed 
as 

L 

y = ^^ai{x + ei) +n (19) 

i=l 

For any forwarding scheme, the SNR at the destination is given by 

GSNR = — ^^^=^ ^ , (20) 

Ei=i oiiEi + E*=i Ei=i,j^i aiajCij + 1 

where Cij = £{e*ej) is the correlation between errors and ej at relays i and j, i ^ j. For the zero correlation 
case (Cij = 0, Vij), it is clear from (l20t that the SNR is maximized when the uncorrelated estimation error at 
the relays (Ei) are minimized. This can also be inferred from the generalized definition of SNR in Error in 
the received symbol at the destination in il9i is a linear combination of errors at the output of relays and the 
destination noise. When the errors are uncorrelated, minimizing the error at the output of each of the relays clearly 
amounts to maximizing SNR at the destination. 

For AF, the correlation C is always zero as the error terms represent independent AWGN noise. For both DF 
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and EF, the correlation depends on the modulation scheme and is not always zero. Although each Ei is minimized 
by EF, due to the possibility of error correlation, maximum SNR is not always guaranteed. However for most 
constellation sets, the error correlation can be shown to be either very close or exactly equal to zero. Theorem |5l 
in Appendix |B] characterizes the rotational property of estimate and forward for MPSK constellation sets and will 
be useful to prove zero correlation property of EF. It proves that, due to the symmetry in the constellation, MMSE 
estimate of a signal rotated by an angle that belongs to a constellation point is the same as the rotated version of 
the MMSE estimate of the signal. 

Xi^re^d^) = e^'^"X(r) where Om = ^,m = 0, 1, ...M - 1, the signal phases of MPSK. 
Theorem 4: Error at the relays that estimate and forward are uncorrected with each other if MPSK modulation 
is employed at the source. 

Proof : In Appendix ICl Thus 8[eie^ = for all MPSK constellation set inputs. This directly suggests that SNR 
achieved at the destination is always the highest with estimate and forward. ■ 

A. Effect of Error Correlation on EF 

The correlation between errors at the output of EF relays, in general, is not zero for all constellations. However 
it is negligible for many constellation sets like M-QAM and it does not result in any tangible SNR loss. In 
fact, the correlation can be expected to decrease for large QAM constellations where the 'edge effects' become 
insignificant. However due to the combination of L{L — 1) terms for the correlation expression in ( l20t . we can 
expect the performance of the system to degrade for very large values of L. In a symmetrical relay network where 
the channel gain of all the links are equal, the SNR for any relay function, as a function of correlation between 
errors is obtained from (EHl as 

GSNR = ^, (21) 

LE + L{L-l)C + l + § 

Suppose the source employs a modulation scheme that results in nonzero correlation between errors with EF in 
a parallel network with unit channel gains, GSNRyii? > GSNR^ii? only if 

As the scaling associated with the correlation is L{L — 1), its effect is prominent for large L. For a given error 
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Single Hop SNR 



Fig. 5. Error Correlation in Estimate and Forward for 16 QAM 



correlation C, GSNRaf > GSNR^f if 



20 25 



(23) 



The above relation along with Fig. |5l suggests that, even if the correlation with EF is nonzero, the number of relays 
has to be very large for AF to outperform EF at high SNR, with modulation schemes like M-QAM. 



B. Error Correlation in DF 

Similar to EF, the error correlation in DF depends on the modulation scheme at the source. For BPSK modulation, 
the error term in uncorrelated estimate of DF from ( fT5t is 



di + 2eiX 
l-2e,; ' 



(24) 



where ej depends on the transmit power and the source-relay channel. From the distribution of di in (fT3b . we can 
calculate the correlation between errors and Cj at relay i and j. 



C = £{eiej) 



£[didj\ + 2ei£[xd.j\ + 2ej£[xdj] + 4:€i€j£[\x\ 

(1 - 2ei){l - 2ej) 
4eiejP - SeieiP + 4eie,P 



(l-2ei)(l-2e,) 







(25) 



For BPSK modulation and with unit channel gain for all the links, the effective SNR at the destination is 



GSNRiji. 



PL^jl - 2eY 
4PLe(l - e) + 1 



(26) 



For large M-QAM constellation ignoring edge effects, the demodulation error can be assumed to be independent 
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of the transmitted symbol, with the distribution given by 





d= i 



1-e 



3d 

-jdm 



(27) 



where, from [23] we have 



6P 



M 

e < 4 I 1 



M J 



Q 



3P 
M - 1 



(28) 



Here we assume that decisions error occur only among the nearest neighbors. Although this is an optimistic 
assumption, it closely predicts the performance of the system at medium and high SNR where the assumption is 
justified. The effective SNR at the destination is. 



GSNRdf 



(29) 



C. Asymptotic GSNR Comparison 

While EF is superior to AF and DP at all SNR regardless of the number of relays, it will be interesting to 
characterize the asymptotic gain of EF as a function of L and P. For ease of analysis, we restrict the channel gains 
to be equal. From the SNR expressions of EF and AF, we have the ratio, 

GSNRef _ LP + P + 1 
GSNRaf ~ LPE{P) +P + E{P) ' 

where E{P) is the mean squared uncorrected error power of EF that is a function of P. Note that the above 
expression does not include the correlation term. Therefore, it is valid only when there is zero correlation between 
the error terms. For any input distribution px{x), i.e. for all modulation schemes. 



E{P) < 1, VP. 
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1 ) Fixed P: With large number of relays , 

GSNRef{P) MSUEEaf 1 GSNRsf(P) MSUEEdf 4Pe(l - e) 



L — > oo, 



GSNRaf(^') MSUEEef E{P) GSNRdf{P) MSUEEef {l-2e)^E{P) 

Notice that MSUEE of the schemes determine the gain. We know from Section. |W]that E{P) decreases with P 
and ultimately becomes zero as P — > .oo. This implies that in a large relay network, maximum gain over AF is 
obtained for high source transmit power P. Similarly maximum gain over DF is obtained at low P. This is due to 
the fact that DF is inefficient at low P as indicated by its mean squared uncorrected error power. 

2) Fixed L: For a fixed number of relays, the GSNR gain of EF over AF at high P is approximately L + 1. 
Similarly the GSNR gain of EF over DF at low P is very high as indicated in the following expressions. 

GSNRef{L) GSNRef{L) 

GSNR^H^) ^^ GSNR^H^) ^ ^ ^ 



GSNREFjL) _ GSNRef{L) _ vr 

^ ' GSNRAF(-^^) GSNRdf{L) 2 ^ ' 

Above expressions clearly demonstrate the inefficiency of DF and AF at low and high SNR respectively. 



D. Numerical Results 

Fig- El provides the GSNR performance of the schemes in a parallel relay network with equal channel gains. The 
corresponding error probabilities are provided in Fig. The error probabilities closely follow the trend exhibited 
in GSNR. It can be seen that EF achieves substantial error probability gains over AF and DF for all values of P. 
As seen in GSNR plot, AF is superior to DF at low P while DF performs better than AF at high P. This is also 
indicated by ( l30b and ( I31t . For our system model, the AF relaying scheme is equivalent to the one proposed in 
[12]. It will be interesting to compare the performance of the schemes with optimal power allocation similar to 
[12]. 

VI. Serial Relay Network 

A serial relay network with Gaussian noise at all receivers in shown in Fig. [S| All the relays are memoryless 
and employ a relay function to transmit a symbol based on its received symbol. It should be noted that the relay 
functions, in general, need not be the same for all the relays unlike in a parallel network. This is due to the fact that 
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Transmit Power in dB 




Fig. 6. Comparison of SNR at tlie destination as a function of 
transmit power P = Pr for a parallel network (L — 2) 



Fig. 7. BER of schemes in a parallel network {L = 2) for BPSK 
modulation 
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Relay L 








— Kt) — ^ 


Destination 



Fig. 8. Serial Network Model 

the noise distribution gets altered at every hop depending on the relay function of the preceding relay for multiple 
relay networks. We assume unit channel gains for the links and equal transmit power at all the nodes for simplicity 
of exposition. 



A. Amplify and Forward 

With AF relays in series, the received symbol at the destination can be expressed as 

L 

VL+i = p^x + Y^ P'm + n. 
1=1 



(32) 



GSNR^F 



B. Demodulate and Forward 

As in Section IV-BI we express the received signal at the destination as 

L 



VL+i = X + ^ + 



n 



1=1 



(33) 



(34) 
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From ( H^t and dTTl i. the effective SNR at the destination with BPSK modulation and for a large QAM modulation 
is obtained. 

BPSK P(l-2e)2 QAM P 

4PLe(l-e) + l Ldl^in<^ + 1 

C. Estimate and Forward 

With estimate and forward at all the relays, the corresponding relay functions varies with each relay as the noise 
distribution gets altered at each link due to nonlinear operations performed at the preceding relay. The relay function 
for the i*^ is given by 

fi{ri) = ai£[x\ri = /j_i(ri_i) + m] 

Proposition 1: In a serial relay network, the last relay should perform estimate and forward for maximizing SNR 
at the destination, regardless of the relay function in the preceding relays. 

Proof : Regardless of the relay functions at the preceding relays, the received signal at the last relay can be 
expressed in the same form as Q- From theorem which is valid for all input and noise distributions, it is 
straightforward that EF at the last relay maximizes the SNR at the destination. ■ 

D. Performance Comparison 

Fig- m compares the destination SNR of the schemes for two serial relays. Here the relay functions for DF and AF 
remain the same for both the relays. For EF, /i(ri) = ai tanh(-v/P?'i) and /2(?"2) = a2£[x\r2 = ai tanh(-v/P?'i) + 
n2]. As expected, EF is the best performing scheme and DF closely follows it. 

It can be easily noticed that in a serial network, the effective SNR decreases with each stage. AF, being power 
inefficient at high SNR, suffers the most due to multi-hop communication. 

GSNR^^ = ^ , < (35) 

For large M-QAM modulation, effective SNR at the destination with DF scheme can be approximated as 

GSNRdf = ^ , , (36) 



Clearly when (i^j„e < 1 (at high SNR regime). 



GSNRdf > (37) 
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Fig. 9. Comparison of SNR at tlie destination as a function of 
transmit power P = Pr for a serial networlc (L — 2) 



Fig. 10. BER of schemes in a parallel network (L = 2) for 
BPSK modulation 



indicates that DF is superior to AF at high SNR. We can also observe the case where GSNR^i? > GSNR/ji? at 
low SNR (when d^j„e > 1). Note that the variance of the error components associated with DF (d^j^e) decreases 
exponentially with P, while those in AF for the k^^ relay) decreases linearly with P. These observations can 
be clearly seen in Fig. |9l where AF performs slightly better than DF at very low SNR. Gradually with increase in 
P, DF outperforms AF and the performance gap widens with further increase in P. 

E. Hybrid Relay Networks 

From the previous sections, we determine that EF is well suited to both parallel and serial relay network regardless 
of P, and substantial performance gain can be obtained over AF and DF in many scenarios. We also observe that 
DF is close to optimal in a serial relay network at high SNR where as AF is near-optimal in parallel relay networks 
at low SNR. In these regimes, the performance gain of EF is limited. Thus, it is interesting to determine the 
performance gain of EF in general memoryless relay networks. Consider a network consisting of both parallel and 
serial subnetworks as shown in Fig. ^2 Due to the presence of parallel and serial elements together in the network, 
we find a significant performance degradation in both AF and DF at all P. Precisely, this is a scenario where EF 
obtains a large gain over the best of DF and AF. Fig. compares the performance of schemes for the hybrid 
network in Fig. It can be noticed that EF performs significantly better than the best of DF and AF. Fig. 
displays the error probability of the schemes for the hybrid network. It can be seen that substantial gain is obtained 
over the best of DF and AF. The performance gain will increase for a large network with both parallel and serial 
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elements. 




Fig. 11. Hybrid Serial Parallel Network 

VII. Conclusion 

In this work, we address a fundamental problem in relay networks that involves determining the set of relay 
functions in a memoryless relay network that maximizes performance. From an estimation point of view, we develop 
a general framework for determining SNR at the destination for all memoryless relay processing. For the single 
relay case, the generalized SNR was shown to be optimized by minimum mean square uncorrelated error (MMSUE) 
estimate which is related to the traditional MMSE estimate by a constant scaling factor. For both parallel and serial 
relay networks, we establish the superiority of EF over DF and AF. We show that, with MPSK modulation at the 
source, maximum SNR is obtained at the destination when the relays estimate and forward, regardless of the number 
of relays. Further, we demonstrate that the last stage of a serial relay network must employ EF for maximizing 
SNR at the destination. For hybrid networks that contain both serial and parallel elements, the advantage of EF 
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Fig. 12. Comparison of SNR at destination as a function of 
transmit power P — Pji for a hybrid network with both serial 
and parallel elements, for BPSK modulation at source 



Fig. 13. BER of the forwarding schemes for BPSK modulation 
for the hybrid network in Fig. 1111 
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over the best of AF and DF is found to be significant. 

Appendix 

A. Relation between MMSUEE and MMSEE 

Although the relay functions arising out of MMSUE and MMSE estimates are identical, they are fundamentally 
distinct as the objectives optimized by them are different. MMSUE is the minimum achievable uncorrected error 
power while MMSE is the minimum achievable distortion. By proving that the correlation of the MMSE error e 
and the input x, we obtain the relationship between MMSE and MMSUE. 

Proposition 2: Correlation between the MMSE error e and the input x is always non positive. 
(Proof : We express the MMSE estimate as 

- fj, 
X[r) = X + e = X + —X + e„, 

where = £^[x*e] and is uncorrelated to x, 

e« = e - (38) 
Consider another estimate which is a scaled version of the MMSE estimate such that 



1 + ^ 1 + ^' 

As MMSE estimation is optimal distortion minimizing method, we have the relation 



S[\ef] < -^Sileuf] (39) 

(1 + p) 

which imphes /x < 0. ■ 
For Gaussian inputs, a unique relationship between MMSE estimate and the correlation exists, which is /x = 
S{Xe) = -MMSEE = A direct consequence of the negative correlation of the error with the signal x leads 
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to the following inequality. 

SNR < 



MMSEE' 



Proposition 3: The minimum mean squared uncorrelated estimation error cannot be less than MMSEE. The 
precise relationship between MMSUEE and MMSEE is 

MMSEE - 4 

MMSUEE = 



+ 

Proof: We have MMSUEE > MMSE, by observing e„ to be the distortion arising out of another estimation 
method that cannot achieve a mean squared estimation error less than MMSEE. The exact relationship between the 
mean square error of these methods can be obtained from i3Sl . 

B. Rotational Property of EF 

Theorem 5: For all MPSK constellation inputs, the MMSE estimate has the property 



where 6'm = m = 0, 1, ...M - 1, the signal phases of MPSK. 

Proof : 



pM-l 



£[x\r = re^'^'"] = ^ e^'^Tr[x = /Pe^" jre-''^'"] (42) 



fc=0 



P e-''^^Pr[x = \/Pe^'e-^'^™|r] (43) 



M 

k=0 



M-1 

e^^" e^^<'=-'"'Pr[x = /Pe^'"—' |r] (44) 

k=0 
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C. Proof for Zero Error Correlation of EF 



Expressing error as the difference of the estimate and the actual symbol, we have 



C = £[eiel] = E[{X{ri)-x){X*{r2)-x*)] 

p2 



£-[x*£-{x\ri = gix + ni)]£[x*£*{x\r2 = g2X + ni)] 



8[8[x\n]S[x*\r2]] 



P 



M-l 



£ [£[x\ri\£[x*\r2]\ 



^ £m£[x\r = giXi + ni]£n,_£[x*\r2 = 92X1 + ^2] 
^ M-l 

— ^ £n£[x\r = gixi + n]£n£[x\r = g2Xi + n] 



i=0 



£n£[x\r = gixo + n]£*£[x\r = g2Xo + n] 



where (147 1 is obtained by applying theorem |5l in (I46t 



Af-l 



x\r = Xi + n\ 



i=Q 



^ M-l 



j=0 



Pfn [£:[x|r = 51x0 + n]] , 



where (l48l is reduced to P9l using theorem |5] Substituting (l47l and P9t in (l45l . we have 



C = f[eie^] 



P£n [£[x\r = giXQ + n]] £* [£[x\r = g2Xo + n] 



P 



(45) 



(46) 
(47) 



(48) 
(49) 



(50) 
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